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(54) CONTROLLER AND CONTROL METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To perform remote control of 
an electronic equipment without using a remote commander. 

SOLUTION: A menu 9 and a cursor 9 are displayed on a 
display device 7 to be a television receiver. On the other 
hand, a picture including a user is picked up by an image 
pickup device and the moving vector of the picture is 
detected by a moving vector detector 6. A controller 5 
moves the cursor 9 correspondingly to the moving vector, 
and when a user selects a required selection item out of the 
menu 9, the display device 7 is controlled correspondingly to 
the selected item. 
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1 .This document has been translated by computer. So the translation may not reflect the original 

■ 

precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A control device which controls electronic equipment, comprising: 
An imaging means which picturizes a picture. 

A motion detecting means which detects a motion in said picture picturized by said imaging 
means. 

A control means which controls said electronic equipment corresponding to a motion in said 
picture detected by said motion detecting means. 

[Claim 2]Have further a displaying means which displays a predetermined menu and cursor, and 
a cursor advance control means to which said cursor is moved corresponding to a motion in said 
picture, and said menu, The control device according to claim 1, wherein it has the selection area 
which becomes by two or more choices and said control means performs control corresponding 
to said choice in which said cursor is located. 

[Claim 3]The control device according to claim 2 when there is [ a predetermined input ] said 
displaying means, wherein it displays a menu and cursor predetermined [ said ]. 
[Claim 4] Have said menu further and definite predetermined area besides said selection area said 
control means, The control device according to claim 2 having become final and conclusive 
selection of the choice, and performing control corresponding to the choice when said cursor 
moves to said definite area from said choice. 

[Claim 5]The control device according to claim 2, wherein said motion detecting means detects a 
motion vector about all objects that are moving in said picture and said cursor advance control 
means moves said cursor among said motion vectors corresponding to the largest thing of a size. 
[Claim 6]Have further a memory measure which memorizes said picture picturized by said 
imaging means, and said motion detecting means, A picture outputted from said imaging means 
after a picture is memorized by said memory measure, The control device according to claim 5 
detecting a motion vector about a difference image which calculates difference with a picture 
memorized by said memory measure, and is obtained as a result as a motion vector of a picture 
outputted from said imaging means. 

[Claim 7] A control method being the control method which controls electronic equipment, 
picturizing a picture, detecting a motion in the picture, and controlling said electronic equipment 
corresponding to the motion. 



[Translation done.] 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to a control device and the control method. It uses, 
when controlling electronic equipment, such as a television receiver, especially, for example, and 
it is related with a suitable control device and the control method. 
[0002] 

[Description of the Prior Art]The remote commander (suitably henceforth a remote control) 
accompanies electronic equipment, such as these days, for example, a television receiver, and an 
air conditioner. 

It is made as [ carry out / by operating this remote control / remote control of the electronic 
equipment]. 

[0003]That is, even if a user is in the position which is separated from electronic equipment, he 
only operates a remote control, and even if he does not do the direct control of the electronic 
equipment, he can perform the control. When electronic equipment is a television receiver, for 
example, specifically, remote control, such as ON and OFF of the power supply, change of a 
channel, adjustment of volume, can be performed. 
[0004] 

[Problem(s) to be Solved by the Invention]By the way, since a remote control is not that with 
which a user always walks around, there is not necessarily to a user. That is, when a user is in the 
position which is separated from a television receiver for example, and it tries to perform the 
operation, the remote control may be placed on the television receiver etc. In such a case, the 
user had to go to take a remote control to the position which has placed the television receiver. 
[0005]Since the latest television receiver is fundamentally made as [ operate / it / with the remote 
control ], about the power button attached to the television receiver itself, operativity is hardly 
taken into consideration. For this reason, when the remote control had been lost, the operativity 
of electronic equipment might get extremely bad. Some latest air conditioners can perform a 
temperature control, setting out of a timer, etc. only with the remote control, and when the 
remote control of such electronic equipment is lost, it becomes impossible substantially to use 
electronic equipment. 

[0006]Even if this invention is made in view of such a situation and does not have a remote 

control, a user enables it to carry out remote control of the electronic equipment. 

[0007] 

[Means for Solving the Problem]written this invention is characterized by it having been alike 
and comprising the following at claim 1 . 
An imaging means which picturizes a picture. 

A motion detecting means which detects a motion in a picture picturized by imaging means. 
A control means which controls electronic equipment corresponding to a motion in a picture 
detected by a motion detecting means. 

[0008] A control method according to claim 7 picturizes a picture, detects a motion in the picture, 
and controls electronic equipment corresponding to the motion. 

[0009]In the control device according to claim 1, an imaging means picturizes a picture, a 
motion detecting means detects a motion in a picture picturized by imaging means, and a control 
means is made as [ control / electronic equipment ] corresponding to a motion in a picture 
detected by a motion detecting means. 



[0010]A control method according to claim 7 picturizes a picture, detects a motion in the picture, 

and is made as [ control / electronic equipment ] corresponding to the motion. 

[0011] 

[Embodiment of the Invention] Although the example of this invention is described below, it is as 
follows, when an example [ / in the parenthesis after each means ] (however, an example) is 
added and the feature of this invention is described, in order to clarify correspondence relation 
between each means of an invention given in a claim, and the following examples before that. 
[0012]Namely, as for this invention, the control device according to claim 1 is characterized by 
that the control device which controls electronic equipment (for example, display device 7 etc. 
which is a television receiver shown in drawing 1) comprises the following. 
The imaging means which picturize a picture (for example, imaging device 3 shown in drawing 

The motion detecting means which detect the motion in the picture pictunzed by the imaging 
means (for example, motion vector sensing device 6 shown in drawing 1) . 
The control means which control electronic equipment corresponding to the motion in the picture 
detected by the motion detecting means (for example, control device 5 shown in drawing 1) . 

[0013]The displaying means (for example, display device 7 etc. which are shown in drawing 1) 
as which the control device according to claim 2 displays predetermined menus (for example, 
menu 8 shown in drawing 7) and cursor (for example, cursor 9 shown in drawing 7) , The cursor 
advance control means to which cursor is moved corresponding to the motion in a picture. (For 
example, control device 5 etc. which are shown in drawing 1) Have further and a menu, It has 
the selection area (for example, selection area 32 shown in drawing 7) which becomes by two or 
more choices, and a control means performs control corresponding to the choices (for example, 
the choice "1" in the selection area 32 shown in drawing 7 . "3", etc.) in which cursor is 
located. 

[0014]The control device according to claim 3 displays a predetermined menu and cursor, when 
predetermined inputs (for example, recognition signal (trigger) from the recognition device 10 of 
drawing 1, etc.) have a displaying means. 

[0015]A menu the control device according to claim 4 Definite predetermined area besides 
selection area. It has further (the for example, definite area (ENTER area) 33 etc. which are 
shown in drawing 7) , and selection of the choice should be become final and conclusive, and a 
control means performs control corresponding to the choice, when cursor moves to definite area 
from a choice. 

[0016]The memory measure the control device according to claim 6 remembers the picture 
picturized by the imaging means to be. The picture to which is further equipped with (for 
example, the frame memory 4 etc. which are shown in drawing 1) , and a motion detecting means 
is outputted from an imaging means after a picture is memorized by the memory measure, 
Difference with the picture memorized by the memory measure is calculated, and the motion 
vector about the difference image obtained as a result is detected as a motion vector of the 
picture outputted from an imaging means. 

[0017]Of course, this statement does not mean limiting to what described each means above. 
MX) 181 Drawing 1 shows the composition of one example of the control system which applied this 
invention. In this control system, it is made as [ carry out / remote control of the display device 7 
which becomes, for example with a television receiver etc. ]. 

[0019]The lighting system 1 is a fluorescent lamp, a filament lamp, etc. which were installed, for 



example into the room, and is made as [ illuminate / a user ]. The filter 2 is an optical filter, 
filters the light which enters there and is made as [ emit / to the imaging device 3 ]. The imaging 
device 3 comprises a lens, CCD (charge coupled device), etc., for example, and is installed on 
the display device 7 etc. And the imaging device 3 is made as [ output / the picture signal which 
picturized the picture as a light which enters there, for example, was based on NTSC system etc. 
]. The frame memory 4 is made as [ memorize / the picture signal which the imaging device 3 
outputs ]. The program which should make CPU1 1 which is memorized by ROM 12, and which 
is different for programming and performs predetermined processing, and CPU1 1 perform the 
control device 5, It comprises RAM13 etc. which memorizes required data and others on 
operation of ROM 12 and CPU1 1 which have memorized data required to display the menu 8 and 
the cursor 9 which are mentioned later, and is made as [ control / the whole system ]. The motion 
vector sensing device 6 is made as [ detect /, for example / a motion vector ] as a motion in the 
picture which outputs the imaging device 3. 

[0020]As mentioned above, the display device 7 becomes with a television receiver etc., and is 
made as [ control / by the control device 5 ] . It has a function as a television receiver, and also 
the display device 7 is made as [ display / the menu 8 and the cursor 9 ] according to control of 
the control device 5. 

[0021]The recognition device 10 recognizes that the user performed predetermined action, and is 
made as [ output / to the control device 5 / a predetermined recognition signal ]. 
[0022] Next, the operation is explained briefly. A user causes predetermined action, when it is 
going to carry out remote control of the display device 7 (for example, when trying to perform 
ON and OFF of a power supply, change of a receiving channel, adjustment of volume, etc.). In 
the recognition device 10, the user's action is supervised, and if predetermined action is 
recognized, a predetermined recognition signal will be outputted to the control device 5. The 
control device 5 will start processing by making it into a trigger, if a recognition signal is 
received from the recognition device 10. 

[0023]That is, the control device 5 controls the display device 7, and displays the menu 8 and the 
cursor 9. The control device 5 makes the imaging device 3 start the image pick-up of a picture, 
and, further thereby, makes the motion vector sensing device 6 detect simultaneously the motion 
in the picture outputted from the imaging device 3. And the control device 5 moves the cursor 9 
displayed on the display device 7 corresponding to a motion of the picture detected with the 
motion vector sensing device 6. And the control device 5 controls the display device 7 
corresponding to the position of the menu to which the cursor 9 is pointing. 
[0024]When what makes a receiving channel a choice is specifically displayed, for example as 
the menu 8 and a predetermined receiving channel is directed by the cursor 9 (selection), the 
display device 7 is controlled to receive the receiving channel. 

[0025]Therefore, a user can change a receiving channel by moving so that the cursor 9 may be 
moved to the position of the receiving channel in the menu 8 for which it asks, after causing 
predetermined action. That is, even if a user does not have a remote control in this case, remote 
control of the display device 7 which is a television receiver can be carried out. 
[0026]Next, the details of the recognition device 10 are explained. The user at the time of the 
recognition device 10 performing remote control with the conventional remote control has a 
remote control, It is made as [ recognize / whether the user caused predetermined action for the 
act which is going to operate a predetermined button, i.e., the volition which tries to perform a 
user's remote control towards the television receiver etc. ]. 

[00271 Drawing 2 shows the example of composition of the recognition device 10 in the case of 



recognizing whether the user uttered the predetermined sound for the volition which tries to 
perform a user's remote control. That is, the recognition device 10 comprises the microphone 21 
and the voice recognition equipment 22 in this case. 

[0028]The microphone 21 is made as [ change / into the audio signal as an electrical signal / the 
sound inputted there ]. The voice recognition equipment 22 is made as [ output / to the control 
device 5 / a recognition signal ], when the sound supplied from the microphone 21 has 
recognized whether it is a predetermined word and has recognized it as the sound being a 
predetermined word. 

[0029]In the recognition device 10 constituted as mentioned above, speech recognition of the 
sound inputted into the microphone 21 is supplied and carried out to the voice recognition 
equipment 22. And in the voice recognition equipment 22, when the sound inputted into the 
microphone 21 has not been recognized by the predetermined word, processing in particular is 
not performed. When the sound inputted into the microphone 21 has been recognized by the 
predetermined word, a recognition signal is outputted to the control device 5, and the menu 8 and 
the cursor 9 are displayed on the display device 7 by making this into a trigger. 
[0030]The predetermined word made into the object of speech recognition is inputting into the 
microphone 21, and can register the word into the voice recognition equipment 22 beforehand. 
[0031]in the above-mentioned case, the sound inputted into the microphone 21 recognized 
whether it was a predetermined word, but it may be made whether have a predetermined 
waveform and for the sound to, recognize whether it has predetermined pitch frequency for 
example In this case, the user can apply a trigger to the control device 5 by playing a whistle, for 
example etc. However, as for a whistle, it is preferred that a trigger is applied, only when a 
whistle is used for applying a trigger and only time predetermined in a whistle has been 
recognized continuously, since it may blow while a child plays, for example. 
[0032]Next, drawing 3 shows the example of composition of the recognition device 10 to which 
a trigger is applied to the control device 5, when a user makes a hand predetermined shape. In 
this case, the recognition device 10 comprises the imaging device 23 and the neural network 24. 
The imaging device 23 is made as [ output / the picture signal which comprised a lens, CCD, 
etc., for example, and picturized the picture as a light which enters there, for example, was based 
on NTSC system etc. J. The neural network 24 recognizes whether the picture signal outputted 
from the imaging device 23 is a thing of the hand of predetermined shape, and when it is a thing 
of the hand of predetermined shape, he is made as [ apply / to the control device 5 / a trigger ]. It 
is made to make the neural network 24 learn the shape of a predetermined hand beforehand. 
[0033]In the recognition device 10 constituted as mentioned above, the image recognition of the 
picture photoed by the imaging device 23 is supplied and carried out to the neural network 24. 
And in the neural network 24, when the picture from the imaging device 23 has been recognized 
not to be a picture of the hand of predetermined shape, processing in particular is not performed. 
When the picture from the imaging device 23 has been recognized by the picture of the hand of 
predetermined shape, a recognition signal is outputted to the control device 5, and the menu 8 
and the cursor 9 are displayed on the display device 7 by making this into a trigger. 
[0034] A trigger can be applied even if it uses the things (for example, back scratcher etc.) of not 
only when a hand is made into predetermined shape in this case, but such shape. 
[0035]The thing using the imaging device 3 of drawing 1 as the imaging device 23 (the imaging 
devices 3 and 23 are made to serve a double purpose) is possible. 

[0036]Not only when a hand is made into predetermined shape but the thing applied in addition 
to this when a leg and the whole body are made into predetermined shape, for example is 



possible for a trigger. However, it is necessary to make the neural network 24 learn beforehand 
the shape used for applying a trigger. 

[0037]Next, drawing 4 shows the example of composition of the recognition device 10 to which 
a trigger is applied to the control device 5, when a user does predetermined operation, such as 
moving both arms, so that it may open, for example. In this case, the recognition device 10 
comprises the imaging device 25 and the motion vector sensing device 26. The imaging device 
25 is made as [ output / the picture signal which comprised a lens, CCD, etc., for example, and 
picturized the picture as a light which enters there, for example, was based on NTSC system etc. 
]. The motion vector sensing device 26 is made as [ detect / the motion vector of the picture ] 
based on the picture signal outputted from the imaging device 25. And the motion vector sensing 
device 26 is made as [ apply / to the control device 5 / a trigger ], when the detected motion 
vector is what two objects express to a motion which is left horizontally. 
[0038]In the recognition device 10 constituted as mentioned above, the picture photoed by the 
imaging device 25 is supplied to the motion vector sensing device 26, and a motion vector is 
detected. And when it is not what the motion vector of the picture from the imaging device 25 
expresses with the motion vector sensing device 26 to a motion which two objects leave 
horizontally, processing in particular is not performed. When the motion vector of the picture 
from the imaging device 25 expresses a motion which two objects leave horizontally, as 
mentioned above, a user, for example, When it moves so that both arms may be opened, a 
recognition signal is outputted to the control device 5, and the menu 8 ai}d the cursor 9 are 
displayed on the display device 7 by making this into a trigger. 

[0039]As the imaging device 25 or the motion vector sensing device 26, it is possible to use the 
imaging device 3 or the motion vector sensing device 6 of drawing 1 , respectively. 
[0040] A trigger is not a case where the motion vector showing a motion which two objects leave 
horizontally is detected, In addition, when the motion vector that two objects approached 
horizontally was detected for example, or when the motion vector that one object goes up 
perpendicularly is detected, it can apply. In this case, a user becomes possible [ applying a 
trigger ] by bringing both arms close, for example, or mentioning the right or the left arm etc. 
[0041] Although the trigger was applied in the above drawing 2 thru/or the example of drawing 4 
- using the body, the trigger can also make a user apply in addition to this using the thing etc. 
which are put on usually, for example. Drawing 5 shows the example of composition of the 
recognition device 10 in case a user applies a trigger to the control device 5 as a thing put on 
usually, for example using a ring. In this case, operation of the switch which is not illustrated 
attaches the light-emitting part 28 as a predetermined modulating signal which emits infrared 
rays to the ring 27 which the recognition device 10 is constituted from the photo-diode 29 and 
the decoder 30, and the user puts on. 

[0042]The photo-diode 29 receives the infrared rays with which the light-emitting part 28 emits 
light, and is made as [ change / into an electrical signal ] (photoelectric conversion). The decoder 
30 is made as [ apply / to the control device 5 / a trigger ], when the electrical signal which the 
photo-diode 29 outputs judges whether it has a specific abnormal-conditions pattern and has a 
specific abnormal-conditions pattern. 

[0043]Next, the operation is explained. A user operates the switch of the light-emitting part 28, 
when it is going to operate the display device 7 which is a television receiver. Thereby, from the 
light-emitting part 28, the infrared rays which have a specific abnormal-conditions pattern are 
emitted. Light is received with the photo-diode 29, and these infrared rays are changed into an 
electrical signal, and are supplied to the decoder 30. In the decoder 30, when it is judged whether 



the electrical signal from the photo-diode 29 has a predetermined abnormal-conditions pattern 
and it does not have a predetermined abnormal-conditions pattern, processing in particular is not 
performed. When the electrical signal from the photo-diode 29 has a predetermined abnormal- 
conditions pattern, the decoder 30 outputs a recognition signal to the control device 5. The 
control device 5 displays the menu 8 and the cursor 9 on the display device 7 by making the 
recognition signal from the decoder 30 into a trigger. 

[0044] Next, with reference to the flow chart of drawing 6 , operation of the control system of 
drawing 1 is explained further. First, in Step SI, it is judged by the control device 5 (CPU1 1) 
whether the predetermined recognition signal of the recognition device 10 was able to be 
received. In Step SI, when judged with the ability of a recognition signal to have not been 
received, it returns to Step SI. When judged with the ability of the recognition signal to have 
been received in Step SI, a user tries to perform remote control, causes predetermined action, 
and by this, As drawing 2 thru/or drawing 5 explained, when a trigger is applied to the control 
device 5, it progresses to Step S2 and the control device 5 displays the menu 8 on the display 
device 7. 

[0045]Here, drawing 7 shows the 1st display example of the menu 8. In this example, the menu 8 
is made into the thing for choosing a channel (change), and has the selection area 33, ENTER 
area, and the elimination area 34. 

[0046] 1, 3, 4, 6, 8, 12, 16, and 42 for the selection area 33 to choose a channel directly as two or 
more choices (these) It has UP or DN showing a channel for rising or bringing down VI, V2, V3 
(these express an external input terminal), and the channel for choosing an external input 
terminal. The ENTER (decision) area 33 is arranged on the right of the selection area 32, and 
when becoming final and conclusive selection of the choice of the selection area 32, it is used. 
The elimination area 34 is arranged on the right of the ENTER area 33, and when eliminating the 
menu 8 and the cursor 9, it is used. 

[0047]While setting the coordinates of most the upper left of the screen of the display device 7 to 
(0, 0), When making the coordinates of most the lower right into (Xmax, Y max ) (however, CkXmax, 
Ymax), in the example of drawing 7 , the menu 8 is displayed on the range of X0<x<X max and 
Yl<y<Y2. And arrange the selection area 32 in the range of X0<x<Xl and Yl<y<Y2, the 
ENTER area 33 is arranged at the range of Xl<x<X2 and Yl<y<Y2, and the elimination area 34 
is arranged at the range of X2<x<X max and Yl<y<Y2, respectively. 
[0048]Progressing to Step S3 after the display of the above menus 8, the control device 5 
displays the cursor 9 on the display device 7 further. The cursor 9 is displayed on the default 
predetermined position on the display device 7 at this time. Let the choice "4" (four channels) of 
the selection area 32 be a default position in the example of drawing 7 (however, a default 
position). It is possible to make it the display position of the choice corresponding to the channel 
of the program which the display device 7 shows, for example rather than to to fix to one display 
position of the choices of the selection area 32 etc. At this time, the cursor supplementary 
information for making the position of the cursor 9 intelligible is also displayed if needed. In the 
example of drawing 7. the portion of the choice "4" in which the cursor 9 is located is expressed 
as a different color from other choices as cursor supplementary information. 
[0049] Although the cursor 9 is made into cross-joint-shaped cursor in the example of drawing 7 . 
the shape of the cursor 9 can use everything but cross-joint shape, for example, arrow shape and 
others, here. 

[0050]In Step S3, as mentioned above, the cursor 9 is displayed and also the image pick-up of 
the picture by the imaging device 3 is started. The first picture picturized with the imaging 



device 3 is supplied to the frame memory 4, and is memorized. And the picture picturized with 
the imaging device 3 is supplied to the motion vector sensing device 6 via the control device 5 
after that, and the motion vector about all the objects that are moving in the picture is detected in 
step S4. 

[0051]Here, in the motion vector sensing device 6, the difference of the picture which the 
imaging device 3 outputs, and the picture memorized by the frame memory 4 is calculated, and it 
is made as [ detect / the motion vector about the difference image obtained as a result / as a 
motion vector of the picture which the imaging device 3 outputs ]. Since the imaging device 3 is 
being fixed on the display device 7 as mentioned above, the background of the picture which the 
imaging device 3 outputs does not change a lot. Therefore, since the data volume of data volume 
of a difference image decreases as compared with the picture which the imaging device 3 
outputs, it becomes possible to ask for a motion vector with a small operation amount. 
[0052]In the motion vector sensing device 6, it is made as [ ask / for a motion vector / divide a 
difference image into a macro block (16 pixels x 16 pixels) etc., for example, and ]. 
[0053] After detection of a motion vector, it progresses to Step S5 and the cursor 9 displayed on 
the display device 7 is moved by the control device 5 corresponding to the motion vector 
(movement controls). That is, when making into (Xoid, Y 0 i d ) the coordinates in which (X M v, 
YmvX and the cursor 9 are located now in the motion vector, the coordinates (X ne w» Y new ) of the 
position which displays the cursor 9 newly are calculated, for example according to a following 
formula. 
[0054] 

(Xnew, Ynew) =(Xoid» Y 0 id) +alpha (Xmv, Ymv) (1) 

However, alpha is a predetermined constant for making a motion vector into a suitable size. 
[0055]Here, two or more motion vectors may be detected in the motion vector sensing device 6. 
In such a case, the thing with the largest size among two or more motion vectors is detected, and 
the motion vector can be used for searching for the coordinates of the cursor 9. Or it is possible 
to carry out grouping of two or more motion vectors by what have turned to the almost same 
direction, to calculate the average value of the motion vector belonging to a group with most 
motion vectors, etc., and to use it for searching for the coordinates of the cursor 9 etc. 
[0056]If coordinates (X new , Y ne w) are searched for, in Step S6, the cursor 9 will be moved to the 
position expressed with coordinates (X new , Y new ) by the control device 5. As for the control 
device 5, whether the coordinates (X ne w, Y new ) of the cursor 9 filling formula X0<X ne w<Xl and 
Yl<Y ne w<Y2 and the cursor 9 judge whether it exists in the selection area 32. When the cursor 9 
exists in the selection area 32, the choice in which the cursor 9 is located replaces with the choice 
currently expressed as a different color from a choice besides former, and it is displayed in the 
different color, and progresses to Step S7. 

[0057] In the picture outputted from the imaging device 3, it is detected with the motion vector 
sensing device 6 by the motion vector about the object which is moving here, and in the control 
device 5. Since the cursor 9 is moved corresponding to the motion vector, the user can move an 
arm etc. to the choice "3" which adjoins it, or "6" the upper part or by moving caudad small from 
the choice "4" in which the cursor 9 was located now in the cursor 9, for example. The user can 
move the cursor 9 to the choice which is in the position which separated more from a choice "4" 
the upper part or by moving caudad greatly about an arm. 

[005 8] Or when a user moves an arm caudad greatly for example, The cursor 9 can be moved to 
the choice "8" etc. which adjoin above a choice "10" by returning the position of an arm to them 
and moving an arm to them up small further, after moving the cursor 9 to the choice "10" in the 



position which is separated from a choice "4" caudad, etc. However, after moving an arm caudad 
greatly and moving the cursor 9 to a choice "10", the position of an arm is not returned but it is 
possible by moving an arm up small to make it move the cursor 9 to a choice M 8" etc. as it is. 
[0059]In the example of drawing 7 . the choice is perpendicularly arranged and constituted by 
one dimension, therefore, as for the selection area 32, a user moves the cursor 9 perpendicularly 
in this case in many cases. When moving the cursor 9 perpendicularly, although what is 
necessary is just to move an arm perpendicularly as mentioned above, the user is difficult for 
moving an arm perpendicularly correctly, and usually moves an arm in the direction leaning 
from the perpendicular direction a little in many cases. Then, the constant beta smaller than the 
predetermined constant gamma and this constant gamma for making a motion vector into a 
suitable size is prepared, and the cursor 9 can be moved to the coordinates (X ne w, Y new ) shown 
with a following formula. 
[0060] 

(X new > Ynew) =(Xoi d , Y 0 w)+ (betaXMv, gamma Y M v) (2) 

[0061]In this case, rather than a horizontal motion, since the cursor 9 is moved to the position 
reflecting a motion of a perpendicular direction, even if a user moves an arm in the direction 
leaning from the perpendicular direction a little, he can move the inside of the selection area 32 
for the cursor 9. 

[0062]On the other hand, the coordinates (X new , Y new ) of the cursor 9 Either of formula 
X0<X ne w<Xl or Yl<Y nC w<Y2, Or when not filling both, it progresses to Step S7 and it is judged 
by the control device 5 whether the cursor 9 fulfills the conditions (suitably henceforth fixed 
terms (or ENTER conditions)) for becoming final and conclusive selection of a choice. 
[0063]It is judged whether whether the coordinates (X new , Y ne w) of the cursor 9 filling formula 
Xl<X ne w<X2 and Yl<Y ne w<Y2 with the example of drawing 7 and the cursor 9 specifically exist 
in the ENTER area 33, for example. In Step S7, when it judges that the cursor 9 does not exist in 
the ENTER area 33, it returns to step S4. 

[0064]When it judges that the cursor 9 exists in the ENTER area 33 in Step S7, That is, when the 
cursor 9 is moved to the ENTER area 33 from the position of one choice of the selection area 32, 
selection of the choice should be become final and conclusive, and the control device 5 performs 
control corresponding to the choice in Step S8. 

[0065]Namely, when the choice by which selection was become final and conclusive is a choice 
"8", for example, the control device 5 displays the program of eight channels on the display 
device 7 which is a television receiver. When the choice by which selection was become final 
and conclusive is a choice "VI", for example, the control device 5 displays on the display device 
7 the picture currentf y supplied to the external input terminal VI . When the choice by which • 
selection was become final and conclusive is a choice "UP", for example, in the control device 5, 
it ************** s display channel of the display device 7 only 1. 

[0066]Then, it progresses to step S9 and it is judged by the control device 5 whether the cursor 9 
fulfills the conditions (suitably henceforth an erasure condition) for eliminating the menu 8 and 
the cursor 9. 

[0067]It is judged whether whether the coordinates (X ne w, Y new ) of the cursor 9 filling formula 
X2<X new and Yl<Y ncw <Y2 with the example of drawing 7 and the cursor 9 specifically exist in 
the elimination area 34, for example. In step S9, when it judges that the cursor 9 does not exist in 
the elimination area 34, it returns to step S4. 

[0068]When it judges that the cursor 9 exists in the elimination area 34 in step S9, It progresses 
to Step S 10, and the menu 8 and the cursor 9 are eliminated from on the display device 7, and 



return to Step SI, it waits to apply a trigger again, and processing after Step S2 is performed. 
[0069]The cursor 9 can be enabled it to move only the inside of the menu 8. When filling 
formula X ne w<X0, the coordinates (X n ew* Y new ) of the cursor 9 called for in Step S5 this Xnew=X0, 
Formula Xmax< When filling X new , filling X n ew=X max and formula Y new <Yl and filling Y ne w=Yl 
and formula Y2<Y new , what is necessary is just made to be referred to as Y ne w=Y2. 
[0070] Next, drawing 8 shows the 2nd display example of the menu 8. In the example of drawing 
7, when the cursor 9 was moved to the ENTER area 33, it was made as [ become final and 
conclusive / selection of the choice in which the cursor 9 was located just before that ], but in the 
example of drawing 8 , selection of the choice in which the cursor 9 is located is made as [ 
become final and conclusive / immediately ]. 

[0071]That is, the menu 8 will be displayed if a trigger is applied in this case. The menu 8 
comprises an example of drawing 8 in the selection area 32 and the elimination area 34 which 
are also the ENTER area 33 explained by drawing 7 . The menu 8 is displayed on the range of 
X0<x<X,nax and Yl<y<Y2 as well as the case in drawing 7 . And the selection area 32 is arranged 
at the range of X0<x<Xl and Yl<y<Y2, and the elimination area 34 is arranged at the range of 
Xl<x<Xmax and Yl<y<Y2, respectively. 

[0072]The cursor 9 is displayed on the position approached for example, shown in the menu 8 by 
a figure middle point line after the display of the above menus 8. Not making into either of the 
choices of the selection area 32 here the position on which the cursor 9 is displayed first in the 
example of drawing 8 , If it is made such, at the same time as the cursor 9 will be displayed, a 
user's volition is because selection of the choice in the display position will be become final and 
conclusive immediately independently. 

[0073] After the cursor 9 is displayed, as the user mentioned above, he moves the cursor 9. And 
when the coordinates (X ne w, Y new ) of the cursor 9 fill formula X0<X ne w<Xl and Yl<Y ne w<Y2, 
That is, when the cursor 9 exists in the selection area 32, the foreground color of the choice in 
which the cursor 9 is located is changed, and the selection is become final and conclusive further. 
Thereby, processing corresponding to the choice is performed by the control device 5. That is, in 
the example of drawing 8 , the selection area 32 serves also as the ENTER area 33, therefore if 
the cursor 9 is moved to the position of one of choices, selection of the choice will be become 
final and conclusive immediately, and a change of a channel which was mentioned above etc. 
will be made. 

[0074] When the coordinates (X ne w, Y new ) of the cursor 9 fill formula XRXnew^max and 
Yl<Y ne w<Y2 (i.e., when the cursor 9 is moved to the elimination area 34), the menu 8 and the 
cursor 9 are eliminated. 

[0075]The coordinates (X new , Y new ) of the cursor 9 are formula X new <XL (however, XL) so that 
the cursor 9 may not move to the position which is not much separated from the menu 8. the 
value smaller than X0 for how many minutes — carrying out - with X new =XL, when filling. 
Formula Xmax< When filling X ne w, filling X new =X ma x and formula Y ne w<Yl and filling Y ne w=Yl 
and formula Y2<Y new , it is desirable that it is made to be referred to as Y ne w=Y2. 
[0076] About the choice "UP 1 ' for rising or bringing down a channel in this case, or "DN." When 
the cursor 9 is moved to the position of a choice "UP" or "DN", It is possible only for 1 to rise or 
bring down a display channel, and to make it rise or bring down a display channel continuously, 
when it is not moved from the position of a choice "UP" or "DN", even if time predetermined in 
the cursor 9 passes after that. 

[0077] Next, drawing 9 shows the 3rd display example of the menu 8. In this example, the menu 
8 comprises the selection area 32 and the elimination area 34 which serves both as the ENTER 



area 33, a choice is arranged circularly and the selection area 32 is constituted. The selection area 
32 is constituted by this example at the choice excluding a choice "V3" t "UP", and "DN" from 
what was shown in drawing 7 (drawing 8) . 

[0078]In this case, the menu 8 is displayed on the range of XL<X<Xmax and YL<Y<Y max . And 
when referred to as Xc=(XL+Xmax) /2, and Y c = (YL+Ymax) / 2, for example, the selection area 
32, It is the outside of the circle of the radius Rl centering on a point (Xc, Y c ), and, similarly is 
arranged inside the circle of the radius R2 centering on a point (Xc, Yc) (however, R1<R2). It is 
within the limits of XL<X<X ma x and YL<Y<Y max , and let the outside of the circle of the radius 
R2 centering on a point (X c , Yc) be the elimination area 34 which serves as the ENTER area 33. 
[0079]When the above menus 8 are displayed, the cursor 9 is displayed, for example on a point 
(Xc, Yc). Then, as the user mentioned above, he moves the cursor 9. And when the coordinates 
(Xncw, Ynew) of the cursor 9 fill formula Rl 2 <(X new -Xc) 2 +(Y ne w-Y c ) 2 <R2 2 , That is, when the 
cursor 9 exists in the selection area 32, the foreground color of the choice in which the cursor 9 is 
located is changed. 

[0080]When the coordinates (X ne w, Y new ) of the cursor 9 fill formula R2 2 <(X new -Xc) 2 +(Y new - Y c) 
2 , That is, when the cursor 9 is moved to the elimination area 34, while selection of the choice in 
which the cursor 9 was located just before that is become final and conclusive and processing 
corresponding to the choice is performed by the control device 5, the menu 8 and the cursor 9 are 
eliminated. 

[0081]So that the cursor 9 may not move to the position which is not much separated from the 
menu 8, When the coordinates (X new , Y new ) of the cursor 9 fill formula X ne w<XL, X ne w=XL, 
Formula Xmax< When filling X ne w, filling X ne w=X ma x and formula YL<Y new and filling formula 
Y max <Y new with Y new =YL, it is desirable that it is made to consider it as Y new =Y max . 
[0082]Next, drawing 10 shows the 4th display example of the menu 8. Not the elimination area 
34 but the selection area 32 serves as the ENTER area 33, and also this example is constituted 
like the example of drawing 9 . Therefore, according to this menu 8, selection of the choice in 
which the cursor 9 is located is become final and conclusive immediately, and a change of a 
display channel is made corresponding to that choice. 

[0083] As mentioned above, according to the control system of drawing K a user cannot be based 
on a remote control but can do remote control of the display device 7 which is a television 
receiver. Therefore, when using a remote control conventionally, the required cell for remote 
controls becomes unnecessary. It becomes unnecessary [ delivery of the remote control which is 
needed when two or more users perform remote control ] . 

[0084]If there is an object (for example, the hand which extended the finger, the thing which the 
ring which shines brightly, the whole body, and a user possess, etc. may be what kind of objects) 
which is moving in the picture which the imaging device 3 picturized according to this control 
system, Since the cursor 9 is moved corresponding to a motion of the object, even if it is a user 
with trouble in a hand, remote control of the display device 7 can be performed by moving a leg, 
the head, etc., for example. 

[0085]Since what is necessary is to perform only recognition of a certain pattern, the recognition 
device 10 can consist of the recognition devices 10 simply (since what is necessary is to perform 
only a specific word and recognition of specific shape as mentioned above). 
[0086] In the control system of drawing 1, since it was made to perform it corresponding to the 
arbitrary objects which are moving rather than performing movement of the cursor 9 
corresponding to a motion of a specific object, even if the object which is moving does not 
understand what it is, remote control can be performed. 



[0087]As mentioned above, although the case where the display device 7 which is a television 
receiver about this invention was applied to the control system which carries out remote control 
was explained, this invention can be applied when carrying out remote control of all the 
electronic equipment besides a television receiver. 

[0088]Although the object illuminated in this example with the lighting system 1 which 
• becomes, for example by a fluorescent lamp etc. was picturized with the imaging device 3, In 
addition, via the band pass filter which passes infrared rays for the object illuminated with the 
infrared lighting system which irradiates with infrared rays, for example, It is also possible for it 
to picturize with the imaging devices (for example, thermograph etc.) which become with the 
element etc. which detect infrared rays, and to be made to perform remote control of electronic 
equipment using the output. 

[0089]In this example, when a trigger was applied, the menu 8 for changing a channel was 
displayed, but it is also possible to display the menu for, for example, performing the menu for 
adjusting volume, initial setting of a device, etc., etc. Thus, what is necessary is just to display 
the main menu for choosing either of two or more menus, when two or more menus are prepared 
and a trigger is applied. 

[0090]In this example, after displaying the menu 8 and the cursor 9, it was made to perform 
remote control by choosing a choice by moving the cursor 9, but it is also possible for it to be 
made to perform remote control, without displaying the menu 8 and the cursor 9. Namely, when 
setting a television receiver as the object of remote control, for example, horizontal or when a 
vertical motion vector is detected, Corresponding to the motion vector, change of a channel or 
adjustment (adjustment of volume or change of a channel) of volume can be performed, 
respectively. In this case, the user can perform change of a channel or adjustment of volume, for 
example for an arm etc. by right and left or moving up and down, respectively. 
[0091]In this example, although the menu 8 was displayed on some screens of the display device 
7, the menu 8 can also be made to display, for example on the whole screen of the display device 
7 in addition to this. 
[0092] 

[Effect of the Invention] According to the control device according to claim 1 and the control 
method according to claim 7, a picture is picturized and the motion in the picture is detected. 
And electronic equipment is controlled corresponding to the motion. Therefore, it becomes 
possible to carry out remote control of the electronic equipment without a remote commander. 



[Translation done.] 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawine lil t is a block diagram showing the composition of one example of the control system 
which carries out remote control of the display device 7 which is a television receiver which 
applied this invention. 

[Drawing 21 It is a figure showing the example of composition of the recognition device 10 of 
drawing 1 . 



[Drawing 31 It is a figure showing the example of composition of the recognition device 10 of 
drawing 1 . 

rDrawing 41 It is a figure showing the example of composition of the recognition device 10 of 
drawing 1 . 

rDrawing 51I t is a figure showing the example of composition of the recognition device 10 of 
drawing 1 . 

f Drawing 61 It is a flow chart for explaining operation of the example of drawing 1 . 
fPrawing 71 It is a figure showing the display example of the menu 8. 
[Drawing 81 It is a figure showing the display example of the menu 8. 
[Drawing 91I t is a figure showing the display example of the menu 8. 
[Drawing lOH t is a figure showing the display example of the menu 8. 
[Description of Notations] 

3 Imaging device 

4 Frame memory 

5 Control device 

6 Motion vector sensing device 

7 Display device 

8 Menu 

9 Cursor 

10 Recognition device 

32 Selection area 

33 ENTER (decision) area 

34 Elimination area 
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*«A4. 
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c o o 3 7 ] mz. @4Hl x-w. mum< i. o 

BJS£lfiW-&fc\ J9r5tO»ftl:L*:**fc:. MM 
3SS5£M;#£jW*>i8t3i8ai 0O«j£f*l£*l.T 
^S. CO**, ^i^ai Ott. S«ga2 5fcJ:tf 

m^^h)mmms2ex'm^tih. mms.25 

SfU-ifcfcl/toBlftfciStftU Wi-tfNTSC^^r 

futW&fl-fCS-^T . -t^BflW)!*^? b^Srtft 
aj-tl>J:^tc=5rSiiTV^. ib#^7 HHfti} 

^-n^zwxx\^< x d%m% z&fi><ox'f>h% 

*. Sottas icHJtf*:Wt*J:3£%3ft.'Oti. 
[0038] ttho «fc 5 Kfllfi£$*iS>t21SSSB 1 0 T 
t±. »&36B2 5 fcj: oTS&SftfcBflW*. 

i». *u\ »*^hiH*aaea2 6TJi, s«§sa 

■%®*z$i-t{><F>X'bh%&. fiD*>, w*tfx-ir#. 

±j£L>t BR£SKJ:3fcIia»U:*£, MW 
i«5fcB»t*WMj3#i. CflSrMJtffcLT. ^ 
- a- 8 13 «* il - V )V 9 #T < X7V 4 KM 7 fc 

[00393 mm.25ttz\i.m^7vm 
m s * ? h ;naaj&a 6 * « v z t ifflmx-b i . 

[004 0] HJtfte. 2oc0i|*t(i:^7k J F^ri6jt 

HftTvK «fc o=5r«&^ S-^-flS^^ h/i^SKiiL*:* 
iW<J:3fc»***MW*WHLfc***. looto 
**&fc'£)Wt&.* 3 CO**. 

[0041] a±.<n®2jbmm4<?>m&mx\i. $t&* 

{£oTHJ 3 CUt#. hUtftt. iff) 

ft. !f#. #g#fcolfC^I>«i£fc'£ffl 

lt . mmm. 5 k f »j *>it6**?>igs&gB 1 0 

* h;M*-F2 9fcitfT3-r30Tltlft3it. * 
fc. a.-<f1fimz-oVX^h%&2HzU.. W&tto* 

mm*ftt&%L%gi28tm r )mt>iix^z>. 



[0042] 7*h:7W*-K2 9te. ft£«2 84<ft 

m-&mm%%i. m&mizm worn) t 
*. wmm%.5i,zhv#zfrv&xotz%i*tix^&. 

[0043] mz, *<nWfci<zr>^xWLmt . a— f 

tt. TUt'v3>S«aT*6r>f^7-U-fSia7i&ai 
ffUJ:3k-f**^. 3feta52 8m^-/f-£SlfH- 

4. intwj:0. ^)ta52 8*^«. ^C0»^- 

?4 *- H 2 9 -CSftSfU «£Ui^fc£&Sft-C , r 
rJ-^OfctftfcSftS. T3-^3 0T'»i. 7*hr 

-Y 3f — H 2 g^/o^smfi^AW^o^Pi^^-y 

v^§£. mz9m\tfihti%\\ i-t. 7*hr-f*- 
H 2 9*^<0«m<l^* { Bf«<0^ia'^->Sr : t-tl.Ji 
T3-r3 0(i. S0tJP5ia5ti2iSfi#S:tlJ^-f 

5. #i«i3sa5{j, rn-^3 0*^wsiifi^hu 

-y;i-9 

[0044] 06<O7n-^-h?r#9gL.T, 

mi<rymmi'XTJ»<7)mmz^x. zt>izmw?&. 
t-f. m^izxT-vrs nza^x. ig&gai o*>^ 

mmm5 (cpui i > tzx^xwfczti*. *t-vt 
suza^x. mmm%.mthztwx'*%ij>'>tz 

rsnza^x. tmmismt&zkffxztikw 

BraoT^i'- 3 yfcS.ru CftfciO, 02^ 

It Mi*:**. XT«/rS2Cjl^, MfflHi5tt. r 
■< xrv* mS.7 IZX- a-8 Sr*^$-*S . 
[0045] ZZX. 07»i. ^-i-8<7)I1S^ 
fciSLTV**.- Cf^HIS^TJi. ^-j.-8li. f-vv 

XUT33, ENTERXUT. fcj;l/>g4xi>73 4 

[0046] StRx'JT33Ji, «»c03l«?Kk IX. 
^>*)V*m&Wk?htz#><7)\, 3. 4, 6. 8, 

12. 16. i> ir/4 2 ( zixhu. +* >*>vzm. 

?) , ^A^SS^fcS^STt^V 1 , V2. fcJ: 
l^V3 (CflMi. ^SA^Sg^fc^T) . Mt^tf-i' 

NfcWLTV^I,. ENTER («^) x«JT3 3«. 3! 
Rx.VT3 2<omHz8MZtlX&'>). S^x»J73 2 
<vgm.<r>mtiit:W2.-t&k$lzm^e>til. iBixy 

734«i. ENTERX'J73 30t»(CES$nTfc 
0. yx a -8fcJ:^-y;l,9fciB*-rSi:^Kffl^ 
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[0047] r-f.X7'M£S7?>HB5c7) s fit, 
£±?)«&S: (0.0) t-fhttUz. &i>£T<?>m 
§t£ (X.„, Y.„) bt&bZ (fit. 0<X. aI , 
Y.„) , ®7cvm$mT\i. *r:*-8tt. X0<x 
<X.„. YKy<Y2<7)&Bfc:£Un$;h.T^&. -£ 
LX. 3SffixD7321i, X0<x<Xl. Yl<y< 
Y20KHtC, ENTERX>J73 3te, Xl<x<X 
2, Yl<y<Y20&fflK. tff*xUT34»i, X2 
<x<X, ai> \\<y<\2<nwmz. -en-ftlES 

[0 04 8] &±<7)£o%*-±-8<7)$&r;&. *ry 
7-S3tC)iA. i|JfflISa5<i, r-f A7*WgS7fc. 

#-y/l-9£fc*3tf6. Cl<Oi:&, ij 
-V)V9\t. T**7MgS7±(flffi5t?)T7*/l'h 

07<OHJSWTJi. 3SiRx'J73 
2co3!t(?K r 4j (A+vV*>V) W. Ty*frh<D& 

■fcSfrOiS ({IU r7=r^K7)fi[S(i, affix 'J 

r 3 2waffi&w^**o^<as£iii£*«.o-ei;S: 
wiif. T-*^7-^-fsiS7^^tr^i.sffl 

t'l^mx-bh) . s ;<7)t§, <zgiz&ix. 

* - y ;w 9 (DOS. £ to* 0 +t < f S - y /HI 
8Mtf8t>^$ix6. 07£O|llfiWC(i, #-y/MtW 
ffi$8iLT. a-Vrt^jWMl/CHiW* r 4 j O 

[0049] ddf. 07<7)HiftWIT*fi. /J-VJV9 
it. J i-im^.<n^~V)Vb^fiX\^htK t-V)V9cn 

ma. -\-*mx?>m. mummm.*<r)fotz?i>z 

[00 50] ^T-yTSSTii. JhaoiaC, *-V 
[0055] ZZX\ h/^amS6^fc^T 

o^^it. sa^iss^? v>v<no%. mm. 

i}-Vi)s9<r>m&1£fri<nizm^hi.olz-thZ 

ttfx-zh. hh\*t. mwmz^rhfr*. imm 

-WifoZlft^X^ZbiOt'? LX-?)V-7ilL. m 

vivemtfWLh^rfr-Tizmthm^? 
<r>. mm^vmrM^. tnt. /j-vfU9<r>m 
mzxty&Mzm^&xoiz-t&ztKt'h'tifitcb 
h. 

[0056] m (x n „, Y n „) tftobhtist. * 
f yrs6iza^x. m9mm.5icx-ox. mmix 

.... y„„) -e«$*i*fiHK:. *-y^9*^SS?#L 
h. Z?>iz. SIS§SS5ii, #-y^9<o&g 
(X n „. Y ne .) SCX0<X ne ,<XifcJ:VYl 



mill. immm3ximzixfi:mwww±. ?u 
-^t'j4ts»&?fiTiati3*is. *lt. *<rm 
\z. s«aiS3T-a«$n^B«j±. »]«gS5£tfL 

fcWt, *<7)W®.ftl l Z}5^Xm\X^b$Sto?'<.XlZ'? 

[oo5i3 zzx*. m*? F;p«?msia6T-«, a 

lfi5IS3* { aj^-ri»B»t, 7W-A^*U4fc:iBttS 
fufcMfceoftfl'fcaaU *<0*!imf#£>*i&ll#Bt6 
(COVYtag#*?hj|*, gf6§SS3#ai:frtSBfll 

«i£13fcL Ju£L£J:3£T-f*7Mga7<7)±C 

DK«*i < c»t*6. stf^ss^aj^-rsBaw^ 

-frntitytc^hnx; 'ptc^m&x'Wi^tYfv 
[0052] it:. m%<? h^mmm iz&^x 

it. £#B«*\ mm 1 6B«x l 6B3W>-??n7 
uv?%t'i,zftmixm<? hrmttbh X Hz%$ 

tix\,->&. 

[0053] HbZKirh/KDtilltimt. XT"/TS5iZ 

m*. *<?>Wi$<7hMztt&ix. Tt^rvjgkW. 
7i,zi$&kZi\t:*t-v>i>9tf. mmmw.5izxr>x^m 
(mmm w*>. mi?h>n (x flV , y 

h«) . *-V>\'9tf^tQ.W.lX^l}m& . 
(X ol(1> Y 0 u) tt&tZ. /t-Vfr9£%l<i&jk 
thQ&om (X„„, Y ne .) ifc^tc L^: 

[0054] 

Y oli ) +a (X HV , Y BW ) (1) 

<Y ne „<Y2£3t£t*>fc* *-y/P9 

affix u r 3 2 rt^iftti-i. a frimztt . 

*-y;i.9*^iffixur3 2rtt:#ttfs«^ *-y 

;U9^g^-|.SffiJS* { , v^iTflwaHRttkJMri 
Xr-yTS7t:jttf. 

[00573 iir. mz^hiwuamwex-it. m 
ffiSS3*>f>aj^$ixsB«^+T\ m^x^mmz 
^x<nm%<9 hfrtfrnzzti. %m&w.5x-\t. * 
<nm%^9 YMzn&Lx*)-V)V9mmztihfr 
t>. x-ifii; mnimk'*'b$<±.ijttMTinz 

WitrtZkiziL-iX. t}-V)V9*. \^i.i]-V)V9W 

umix^tz&m. r 4 j -emcBis-fsaffiK 

f3j ifcJi r 6j (c:&i&$-tf:6.rfc#-C£i>. 
x-^fli, S65:*# < LUt td&THizmfr-rz t tzi 
oT. Sffite r 4 j J: OSiiT/cttStcftSSffite 
IZ. *-V>U9&mi2ithZttfX'Z?>. 

[0 0 58] h&^it. mm. 3.— fit. m 
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*£<THlz®fri-ZklzX-oX. SStRft U j *»6T 

mzmhtefiLmzh&MfflL r 1 o j 

'h*<JJ!rCIW»f ikJ=J:"-»T. Sffift r 1 0 j <0± 
^KMS? &9fttt r 8j £k'K. #-y*9*M3 

*-viP9*wut r i o j (c^ift^-tt^a. mm. 

izXtX* #-y/W9«\ SiK& r 8j fc»IJ3tf&J: 
[0059] a7^JWtli, XRXU73 2 

[006 1] J: 0 1 , Sffifr 

frtfcfcLTb. *-y*9*. StKx'J73 2rt$;# 

[0062] -tf . ft-yjl^OM ( X ne , , Y,„ ) 
*». *X0<X B „<XlifcttYl<Y B „<Y2«H 

3rtt (HT. JiS. «5£3fefr (*fcliENTER*tt) 

Six*. 

[0063] JMMttcl*. «itf . H7 OWtffCtt. 
^-y^903SK(X,... Y ne „)#. iXKX ul 
<X2fcit^YKY ne ,<Y25r}lfc-r*»t'9*\ BP 
*>. i}-V)V9iiK ENTERX'JT3 3rtteflqt-fi 

*£3MfflC3fc.*. *Ty7*S7fc:i$vvc. *-y 

^9* { . ENTERXUrSSrtfc^fcLSr^fcW^S 

[00 64] Xf »/TS7tC*JV^T. #-y/P9 
ENTERX'JT3 3rt(Cffittl)i:fl^$ilfc« 
BJUj. H-Vfr9tf, S«?x'JT3 2<0V^*H0 
SIRR^S* 1 ^ ENTERX'JT3 3(C^S$fUt 

otu xr'/rs8fcijv^T, toafttttcttj&Lfc 
[ o o 6 5 ] attaajgsftfcafttt*, mta 

Mm. r 8j 81»§lg5te, fl'fy'jy 

g«»T*4T-f -*:TM8ft7fc. 8^>-^/Uco# 

fUKawft r up j t**«&. siamBstcfc 

wc. -f-f xru4&S7«^*--vv*/Wi<ifc"»-M 
[0066] **>tfc, Xr-yrS9tJi*. a-yiW 



NtlhH'CfcJWri. Rft"(?M*a 

££R (X M „. Y„„) fcmt)Z-<iS>j:olztlZi:tf 
X'Z&. 
[0060] 

old) + (/9X HV . rY BV ) (2) 
RfBS«5fcJ:o , Cffi&5fi.*. 

[0067] jumeii. witr . H7«wi«ctt. 

*-y*9fl« (X ne ,. Y ne „) 5CX2<X ne . 
*»J:VYl<Y D „<Y2*«fc-r*»ifd*», B0*>, # 

S 4 CK« . 

[00 68] Xf'yrS9(cj3V>"C, *-Y/k9 
1)K m£x>)73 4ftlZfttEtZtm%ZtltlWr&. X 

T-vrs i otitA, ^c-a-8isj:v*-yrt'9*». 
r-fxrw'fiia7±*>^Ti*s^ xf'yrsics 

0. WIS. hU^*W^SOS:1foT, Xf77S 
[0069] Srfc. *-y;U9tt. >-a-8^AJ: 

Zflii. XT'vTS5l,Zii^XllL#>t>1\tzti-V)V9<r> 

mm (x„„, Y ne .) tfi. ^x ne ,<xo?r}i^-r%& 

liX„„ = X0 fc , ^x„ ai <x n „ $-)H^-f*^»ix ne „ 
= X.„t, ^Y ne .<YlSrSS^1-^liY ne . = Yl 
*Y2<Y M .tiife-M^iY B ..=Y2k-f*J: 

[0 0 70] B8(i, ^Xj L -8«m2*^$' 

^LTV^S. H7<OHJfi0«T-{i. ENTERX'JT3 3 

9)8^UTV^««WIW)aHWa««*i4 J: o t^rS 

^hwm<vmw, wmiziB&zti&±oiz%ztix 

[0071] ^O^, h U^Xt^iiS t . 

8«i. 07t^HHLfcENTERxUT3 3Tt*4a 
KX973 2«J:tfffi£xU73 4TffiRt$ilTV^. 
>-i-8li. 07(Cfc»tS^tPStC. X0<x< 
X.„. Yl<y<Y2<0gfflfc*|jn$*VO^. -ft 
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"C. aS?XU73 2(1. XO<x<Xl , Yl<y<Y 
2WKfflt, ?8£xy734(i. XKx<X.„. Y 

i<y<Y2<oKHt, weftsasix-o^. 
;u 9 *< . * - a- 8 tzmm-r h . «»i t if a+^iT^-r 

Sat^SfiS. .I-IT. 08coHSfiWct3^T. * 
-y^9£gl3J(::f^$-£l><aa3\ Stf?xU73 2<0 

tZblMmLVMIRtf. x— tf<OS*i liasfltl&C:. BP 

[0073] tr-V/V9tfi$&iZtlt:mt. a~*f(l. 

-V)V9<»im (X„„. Y ne „)#. ^X0<X„ e> ,< 
XlfcJ:tA r l<Y ne „<Y2£i8*:-ri§£. 

#-y;w9*<8Sflxy73 2rt(c?ftrf£>*§£. #-v 

/^9frWtl>iM^tf>^fe#^Sft. ££>(;:, * 

fcflUia*. *IffleiS5t=J:oTtTi5^S. W*>. 08W 
ieWSg9-C(i, S^X'JT3 2<i, ENTERX'JT3 3 

&«D(aa(c#»$ftSi:. ^OS5?te<oa!«WHIffiCi| 

[00 74] *-y^9<0)SS (X B „. Y n „) 
aXl<X B ..<X., 1 43j:VYl<Y 1 ,„<Y2fc 
ffitz-t®£. o£9, *i-V>l>9tf. fl!£xy73 4<C 
#»$;h.£*§£. >Xa-8i3«t^-y^9*«$ 

[00 7 5] i]-V)V9ifi^ *-j.-8frt>&£ 

'OMixtiim^WiL^^oiz. ij-V)V9<nm% 

(X ne ,, Y ne „) i«X„ e ,<XL ((it. XLI1. 
XOiOlft^'J^^fflfc-tS) Sr)8*r$-l§£(lX ne ,= 
XLfc. j£X aai <X ne .S:ii*rr*&S(lX Iie .=X 
...t. *Y B ,.<Yl*ilfc*»attY B ..-Ylfc. 
5SY 2 < Y ne , t|R:?*6liY B .. = Y 2 fc-f 3> «t 0 IZ 

[0 0 7 6] d?)*§£\ +v>*>\siT-s7ttz 
\W7V&khK#><7$SmL r UPj 4 fc|J TDNj (C 

owed. iMiKJg ruPj Jfcli r DN j oftSK. * 
-y;U9**#»;*iTJtfc£(;:. *jjc*-* v*JHr 1 *ftt 
TvrttMf*? >Zit. *<ofc. rt-y/i^tf. SIR 
E fUP j ifcii r DN j <0&B*>£. BrjgOBSiajWfcl 
&L?L8l B 3*i£;&>->*:fc&£tt. 

[00 7 7] i^fc, 09(1. >-jL-8WS3^M5r 
*LT»4. COXttHC&WCtt. >Xjl-8(1. 3! 
0?xy732fc. ENTERxy73 3£3fcbl>?l£x 
•J73 4i:-efl|j£2ii. 3S?x'J73 2li» SiRRtfPJ 



11. SftxUT3 2(l. 07 (H8) (3i*Lfct><0A» 
£>. i"V3j . ruPj , fcjtf r D Nj £R*vi 

[00783 Z<7)Wr£. ^-jl-8«. XL<x<X 

YL<y<Y. ai aCT£ft*&vOi*. *L 
T. «itf. X c = (XL + X.„) /2. Y c = (YL 
+Y.„) /2b?lbZ. S^X'JT3 2{±. £ 

( Xc , y c > £«t*&fc-r*¥&R i *>pw>H*e*o 
■c, i»it<^(Xc, y c ) i<t»bb-r&tmR2<?>n<?) 

flfflfcEaSflTO*, (fflL. R 1 <R 2 ) . tti. X 
L<x<X. ai , YL<y<Y„ I 60S5Hrt-C*oT. £ 
(X c , Y e ) &>t»bb-tZ i mR2<?>Pimmtf. EN 
TERxy T3 3 $r«iaSM*x y T 3 4 1 3ftT O 
h. 

[0079] Oh<7)i: 0^Xa-8*^$fUt^ 
A-y;W9ii. 0U(fA (X c . Y c ) C:*c5p3fl 

*ft®th* -5-LT. *-V;U9*)ffi« (X n „, 
Y B „)*». 3<iR12< (X ne „-X c )2+ (Y„„- 
Y c ) KR22*)t^-f*^. *)tl-V>V9ifim(. 

xur3 2Wcff!£Ts^. ^-y;P9#(asi-i»a! 

[0 08 0] itz. /l-Vfr9V>mm (X„... Y„„) 
5SR2*< (X„„-X c ) 2 + (Y n „-Y c ) 

fc-r»*. o*9. *-y;u9*«. aHcxyr3 4fc» 
*<oauK^-y^9*«ffl[itLTv^a 

SWBa5lcJ:->-rfffah.*ki:fct:. ^-A-8fci 
[0 081]^fc. ^-y;U9*<. ^Xj.-8*^J>4 

0(lth.^fiatc»ttL^^J:3(c. ii-V)V9<r>W& 

(X ne ,, Y ne .)*<. 5CX ne .<XL5rg}^-r^J±X 

„„ = x l b . 5$x. ai <x ne , *mti?m&\ix. atm = x 

aai t. ^YL<Y ne .Srjl^-r«-&JiY ne , = YLi:. 

^Y-«<Y n „?r}is^^^(iY na .=Y"«fc-r& e ta 

[0 082] ifcfc, 010(1. >-jL-8^m4S^9 
5r*LTV^. i<0Htt(W(l, ?f*xy73 4T'(i& 
<. SJf?X')T3 2*<. ENTE RX'JT3 3£58MaT 
v^ffid. 09<?5H{gWIi:^S(cfllJ£$ti-C^S. Isfo 
T. d<0^-jL-8(cJ:*i»f. ^-y;U9*«(aBL-CV^ 
SStWS^SJIW 1 . wa(c«g«it. -E-^SiRKt^fe 

[0083] UUiWJ: 3 fc. 0 1 co»l»^^TA(c«}:fi 
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[0 0 84] S^fc. ZVfflWi'ZTMzXtUf. WM 

m.3tfimit:wmtz. mwiim mum 

[00 85] £tZ. 12&SE1 OTti. bh>W-V<?> 
imfzVifttli&WX' (±JttfcJ:3fc:, ft£<o# 
g*. #%.<r)mtntm<r)*&fitl$&^<r>X-) , !2t$ 

i o m&mizmm- h z k wx'$ & . 

[00 86] SA>fc, 0 1 <0«B»^Xr ATJi, jfr-V 

[ 0 0 8 7 ] &±. , -jrU t*^ a *5WC* 

*•? * xru-f 2SB7£ill@iWWSiWffl^^M;:a 

[00 88] &i>, *atWt=*JV^Ttt, 0Utt9t**T 

*irr**!WWMi i Tjsws<ifc**t jm«hi 3 t 

*4AVH^«7 llVfZitLX* %9\-&&8#ath% 

?%b'X'%hm%m <«i«r, ^-*/77^t*) t 

JMU tJHwc , VHMKtiUMMtft* 

[ 0 0 8 9 ] tii . J«WIWni, b U #*<>Mt£>fUfc 

- a -£ if* *SR*6 J: o fcrf 6 d t *HTC* 

[00 90] SfclC. *36*tt«i. ^Xa-Sfcitf 
^-i-8fciI/*-V/l'9?r«^rt*-ftcafR*l 



*/K03QS ) £ *h.<Wiff 3 J: 5 fcf* z t a*c* I . 
Z<7)%&. x~ fli. ffl£lflt&?*^*fcM±TC 

[0 09 1 ] *HJSWfcfcv^T{i> ^-jl-8 

x-*-8ii. .rote. mi\iT<xr\s4$i 

m 7 4)B®£ftC^TI> <fc 3 fcrt £ .1 fc t> TOTC* 

[0092] 

mmm^ mm i teioiinitsJitm 

[«0fS#S!fcBliJ 

[01 ] rWt'j/ 3 yS««T'J)S 

[02 ] a i oisi^s i o<rMfm*TFtm?hh . 
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